Upgrade Lute by Nicell · Pull Request #632 · MDA2AV/HttpArena

Nicell · 2026-04-24T21:23:59Z

Description

WIP, testing newer version. Will open from draft once a proper release is out!

PR Commands — comment on this PR to trigger (requires collaborator approval):

Command	Description
`/benchmark -f <framework>`	Run all benchmark tests
`/benchmark -f <framework> -t <test>`	Run a specific test
`/benchmark -f <framework> --save`	Run and save results (updates leaderboard on merge)

Always specify -f <framework>. Results are automatically compared against the current leaderboard.

Run benchmarks locally

You can validate and benchmark your framework locally with the lite script — no CPU pinning, fixed connection counts, all load generators run in Docker.

./scripts/validate.sh <framework>
./scripts/benchmark-lite.sh <framework> baseline
./scripts/benchmark-lite.sh --load-threads 4 <framework>

Requirements: Docker Engine on Linux. Load generators (gcannon, h2load, h2load-h3, wrk, ghz) are built as self-contained Docker images on first run.

Nicell · 2026-04-24T21:24:23Z

/benchmark -f lute

github-actions · 2026-04-24T21:24:31Z

👋 /benchmark request received. A collaborator will review and approve the run.

github-actions · 2026-04-24T21:24:47Z

🚀 Benchmark run triggered for lute (all tests). Results will be posted here when done.

github-actions · 2026-04-24T22:02:34Z

Benchmark Results

Framework: lute | Test: all tests

Test	Conn	RPS	CPU	Mem	Δ RPS	Δ Mem
baseline	512	2,663,939	6571.9%	139MiB	+4.9%	+37.6%
baseline	4096	2,666,513	6649.5%	162MiB	+3.9%	+22.7%
pipelined	512	11,822,067	6714.9%	125MiB	+1.4%	+27.6%
pipelined	4096	11,981,347	6712.6%	160MiB	+2.4%	+24.0%
limited-conn	512	1,918,252	5911.6%	137MiB	+4.3%	+28.0%
limited-conn	4096	2,224,686	6411.0%	175MiB	+7.0%	+25.0%
json	4096	96,515	6476.5%	178MiB	+46.8%	+28.1%
json-tls	4096	97,421	6490.3%	216MiB	+48.9%	+18.7%
upload	32	942	1745.2%	4.3GiB	+2.4%	+7.5%
upload	256	982	2927.4%	6.3GiB	-2.1%	-4.5%
echo-ws	512	3,236,556	6459.8%	132MiB	+4.1%	+36.1%
echo-ws	4096	3,135,748	6561.2%	196MiB	+4.5%	+16.0%
echo-ws	16384	2,785,544	6289.9%	432MiB	+5.1%	+11.3%

Full log

gcannon v0.5.2 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     512 (8/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    157us    145us    253us    354us    560us

  16182782 frames sent in 5.00s, 16182781 frames received
  Throughput: 3.24M req/s
  Bandwidth:  21.60MB/s
  WS upgrades: 512
  WS frames:   16182781
  Latency samples: 16182721 / 16182781 responses (100.0%)
[info] CPU 6459.8% | Mem 132MiB

=== Best: 3236556 req/s (CPU: 6459.8%, Mem: 132MiB) ===
[info] saved results/echo-ws/512/lute.json
httparena-bench-lute
httparena-bench-lute

==============================================
=== lute / echo-ws / 4096c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.2 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   5.78ms   5.76ms   6.28ms   6.70ms   8.13ms

  3499200 frames sent in 5.00s, 3495232 frames received
  Throughput: 698.88K req/s
  Bandwidth:  4.80MB/s
  WS upgrades: 4096
  WS frames:   3495232
  Latency samples: 3495232 / 3495232 responses (100.0%)
[info] CPU 1002.1% | Mem 168MiB

[run 2/3]
gcannon v0.5.2 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   1.30ms   1.28ms   1.59ms   1.94ms   2.47ms

  15679681 frames sent in 5.00s, 15678744 frames received
  Throughput: 3.13M req/s
  Bandwidth:  20.96MB/s
  WS upgrades: 4092
  WS frames:   15678744
  Latency samples: 15678692 / 15678744 responses (100.0%)
[info] CPU 6561.2% | Mem 196MiB

[run 3/3]
gcannon v0.5.2 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   1.31ms   1.29ms   1.59ms   1.93ms   2.28ms

  15624663 frames sent in 5.00s, 15624470 frames received
  Throughput: 3.12M req/s
  Bandwidth:  20.86MB/s
  WS upgrades: 4096
  WS frames:   15624471
  Latency samples: 15624403 / 15624470 responses (100.0%)

  WARNING: 18446744073709551615/15624470 responses (118063166774358.1%) had unexpected status (expected 2xx)
[info] CPU 6368.9% | Mem 193MiB

=== Best: 3135748 req/s (CPU: 6561.2%, Mem: 196MiB) ===
[info] saved results/echo-ws/4096/lute.json
httparena-bench-lute
httparena-bench-lute

==============================================
=== lute / echo-ws / 16384c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.2 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   5.72ms   2.73ms   15.50ms   16.20ms   18.30ms

  12561455 frames sent in 5.00s, 12545071 frames received
  Throughput: 2.51M req/s
  Bandwidth:  17.32MB/s
  WS upgrades: 16384
  WS frames:   12545071
  Latency samples: 12545071 / 12545071 responses (100.0%)
[info] CPU 4843.7% | Mem 376MiB

[run 2/3]
gcannon v0.5.2 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   5.84ms   5.81ms   6.43ms   6.91ms   7.49ms

  13899051 frames sent in 5.00s, 13882667 frames received
  Throughput: 2.78M req/s
  Bandwidth:  19.10MB/s
  WS upgrades: 16384
  WS frames:   13882667
  Latency samples: 13882667 / 13882667 responses (100.0%)
[info] CPU 6563.5% | Mem 432MiB

[run 3/3]
gcannon v0.5.2 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   5.84ms   5.83ms   6.37ms   6.97ms   7.56ms

  13944106 frames sent in 5.00s, 13927722 frames received
  Throughput: 2.78M req/s
  Bandwidth:  19.16MB/s
  WS upgrades: 16384
  WS frames:   13927722
  Latency samples: 13927722 / 13927722 responses (100.0%)
[info] CPU 6289.9% | Mem 432MiB

=== Best: 2785544 req/s (CPU: 6289.9%, Mem: 432MiB) ===
[info] saved results/echo-ws/16384/lute.json
httparena-bench-lute
httparena-bench-lute
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-tls-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-32.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
[info] restoring loopback MTU to 65536
[info] restoring CPU governor → powersave

Nicell · 2026-04-24T23:27:04Z

/benchmark -f lute

github-actions · 2026-04-24T23:27:11Z

👋 /benchmark request received. A collaborator will review and approve the run.

github-actions · 2026-04-24T23:27:27Z

🚀 Benchmark run triggered for lute (all tests). Results will be posted here when done.

github-actions · 2026-04-24T23:37:56Z

Benchmark Results

Framework: lute | Test: all tests

Test	Conn	RPS	CPU	Mem	Δ RPS	Δ Mem
baseline	512	2,004,094	3438.9%	82MiB	-21.1%	-18.8%
baseline	4096	2,011,931	3317.6%	107MiB	-21.6%	-18.9%
pipelined	512	9,591,324	3277.2%	73MiB	-17.8%	-25.5%
pipelined	4096	9,450,323	3218.5%	106MiB	-19.3%	-17.8%
limited-conn	512	1,345,485	3144.8%	82MiB	-26.9%	-23.4%
limited-conn	4096	1,522,791	3261.0%	118MiB	-26.8%	-15.7%
json	4096	85,666	3217.0%	112MiB	+30.3%	-19.4%
json-tls	4096	82,154	3206.5%	153MiB	+25.6%	-15.9%
upload	32	952	1515.8%	2.9GiB	+3.5%	-27.5%
upload	256	1,024	2830.6%	5.1GiB	+2.1%	-22.7%
echo-ws	512	2,158,520	3404.5%	82MiB	-30.6%	-15.5%
echo-ws	4096	2,061,084	3300.8%	144MiB	-31.3%	-14.8%
echo-ws	16384	1,838,407	3260.7%	335MiB	-30.6%	-13.7%

Full log

gcannon v0.5.2 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     512 (8/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    238us    233us    326us    429us    471us

  10713381 frames sent in 5.00s, 10713379 frames received
  Throughput: 2.14M req/s
  Bandwidth:  14.30MB/s
  WS upgrades: 512
  WS frames:   10718351
  Latency samples: 10713345 / 10713379 responses (100.0%)

  WARNING: 18446744073709546644/10713379 responses (172184182728059.4%) had unexpected status (expected 2xx)
[info] CPU 3378.0% | Mem 81MiB

=== Best: 2158520 req/s (CPU: 3404.5%, Mem: 82MiB) ===
[info] saved results/echo-ws/512/lute.json
httparena-bench-lute
httparena-bench-lute

==============================================
=== lute / echo-ws / 4096c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.2 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   4.40ms   4.37ms   4.82ms   5.15ms   5.78ms

  4588869 frames sent in 5.00s, 4584901 frames received
  Throughput: 916.77K req/s
  Bandwidth:  6.26MB/s
  WS upgrades: 4096
  WS frames:   4584901
  Latency samples: 4584901 / 4584901 responses (100.0%)
[info] CPU 1293.0% | Mem 127MiB

[run 2/3]
gcannon v0.5.2 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   2.04ms   1.94ms   2.59ms   2.84ms   2.93ms

  10053058 frames sent in 5.00s, 10051522 frames received
  Throughput: 2.01M req/s
  Bandwidth:  13.47MB/s
  WS upgrades: 4096
  WS frames:   10051522
  Latency samples: 10051499 / 10051522 responses (100.0%)
[info] CPU 3401.1% | Mem 149MiB

[run 3/3]
gcannon v0.5.2 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   1.99ms   1.92ms   2.57ms   2.88ms   3.01ms

  10305548 frames sent in 5.00s, 10305420 frames received
  Throughput: 2.06M req/s
  Bandwidth:  13.76MB/s
  WS upgrades: 4096
  WS frames:   10305420
  Latency samples: 10305377 / 10305420 responses (100.0%)
[info] CPU 3300.8% | Mem 144MiB

=== Best: 2061084 req/s (CPU: 3300.8%, Mem: 144MiB) ===
[info] saved results/echo-ws/4096/lute.json
httparena-bench-lute
httparena-bench-lute

==============================================
=== lute / echo-ws / 16384c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.2 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   8.64ms   8.56ms   16.50ms   17.50ms   40.20ms

  8459824 frames sent in 5.00s, 8443440 frames received
  Throughput: 1.69M req/s
  Bandwidth:  11.84MB/s
  WS upgrades: 16384
  WS frames:   8443440
  Latency samples: 8443440 / 8443440 responses (100.0%)
[info] CPU 2788.5% | Mem 306MiB

[run 2/3]
gcannon v0.5.2 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   9.29ms   8.85ms   11.70ms   12.50ms   13.20ms

  8745747 frames sent in 5.00s, 8729363 frames received
  Throughput: 1.75M req/s
  Bandwidth:  12.22MB/s
  WS upgrades: 16384
  WS frames:   8729363
  Latency samples: 8729363 / 8729363 responses (100.0%)
[info] CPU 3416.1% | Mem 336MiB

[run 3/3]
gcannon v0.5.2 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   8.83ms   8.37ms   11.30ms   12.10ms   12.70ms

  9208420 frames sent in 5.00s, 9192036 frames received
  Throughput: 1.84M req/s
  Bandwidth:  12.84MB/s
  WS upgrades: 16384
  WS frames:   9192036
  Latency samples: 9192036 / 9192036 responses (100.0%)
[info] CPU 3260.7% | Mem 335MiB

=== Best: 1838407 req/s (CPU: 3260.7%, Mem: 335MiB) ===
[info] saved results/echo-ws/16384/lute.json
httparena-bench-lute
httparena-bench-lute
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-tls-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-32.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
[info] restoring loopback MTU to 65536
[info] restoring CPU governor → powersave

Nicell · 2026-04-25T00:11:43Z

one last one, then I'll wait for our proper release, ty!
/benchmark -f lute

github-actions · 2026-04-25T00:11:50Z

👋 /benchmark request received. A collaborator will review and approve the run.

github-actions · 2026-04-25T00:12:08Z

🚀 Benchmark run triggered for lute (all tests). Results will be posted here when done.

github-actions · 2026-04-25T00:28:08Z

Benchmark Results

Framework: lute | Test: all tests

Test	Conn	RPS	CPU	Mem	Δ RPS	Δ Mem
baseline	512	2,705,321	6622.2%	134MiB	+6.5%	+32.7%
baseline	4096	2,698,802	6657.8%	159MiB	+5.2%	+20.5%
pipelined	512	12,174,060	6653.7%	121MiB	+4.4%	+23.5%
pipelined	4096	12,079,180	6301.0%	155MiB	+3.2%	+20.2%
limited-conn	512	1,949,434	5895.6%	134MiB	+6.0%	+25.2%
limited-conn	4096	2,250,715	6260.3%	173MiB	+8.2%	+23.6%
json	4096	216,779	6317.4%	176MiB	+229.6%	+26.6%
json-tls	4096	211,562	6356.5%	204MiB	+223.4%	+12.1%
upload	32	968	1339.0%	4.4GiB	+5.2%	+10.0%
upload	256	1,000	3204.8%	6.3GiB	-0.3%	-4.5%
echo-ws	512	3,273,530	6554.0%	130MiB	+5.3%	+34.0%
echo-ws	4096	3,204,261	6575.7%	191MiB	+6.8%	+13.0%
echo-ws	16384	2,798,561	6574.7%	431MiB	+5.6%	+11.1%

Full log


[run 3/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     512 (8/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    156us    148us    234us    332us    456us

  16332332 frames sent in 5.00s, 16334768 frames received
  Throughput: 3.27M req/s
  Bandwidth:  21.80MB/s
  WS upgrades: 512
  WS frames:   16334768
  Latency samples: 16332269 / 16334768 responses (100.0%)
[info] CPU 6460.8% | Mem 129MiB

=== Best: 3273530 req/s (CPU: 6554.0%, Mem: 130MiB) ===
[info] saved results/echo-ws/512/lute.json
httparena-bench-lute
httparena-bench-lute

==============================================
=== lute / echo-ws / 4096c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   5.22ms   5.23ms   5.48ms   5.71ms   7.06ms

  3867475 frames sent in 5.00s, 3863443 frames received
  Throughput: 772.51K req/s
  Bandwidth:  5.30MB/s
  WS upgrades: 4096
  WS frames:   3863443
  Latency samples: 3863443 / 3863443 responses (100.0%)
[info] CPU 1091.3% | Mem 162MiB

[run 2/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   1.28ms   1.25ms   1.52ms   1.84ms   2.15ms

  16021876 frames sent in 5.00s, 16021309 frames received
  Throughput: 3.20M req/s
  Bandwidth:  21.40MB/s
  WS upgrades: 4095
  WS frames:   16021309
  Latency samples: 16021269 / 16021309 responses (100.0%)
[info] CPU 6575.7% | Mem 191MiB

[run 3/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   1.28ms   1.27ms   1.52ms   1.85ms   2.21ms

  16007766 frames sent in 5.00s, 16007638 frames received
  Throughput: 3.20M req/s
  Bandwidth:  21.37MB/s
  WS upgrades: 4096
  WS frames:   16007638
  Latency samples: 16007558 / 16007638 responses (100.0%)
[info] CPU 6376.1% | Mem 191MiB

=== Best: 3204261 req/s (CPU: 6575.7%, Mem: 191MiB) ===
[info] saved results/echo-ws/4096/lute.json
httparena-bench-lute
httparena-bench-lute

==============================================
=== lute / echo-ws / 16384c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   5.66ms   2.88ms   15.20ms   16.30ms   18.20ms

  12757933 frames sent in 5.00s, 12741551 frames received
  Throughput: 2.55M req/s
  Bandwidth:  17.58MB/s
  WS upgrades: 16382
  WS frames:   12741551
  Latency samples: 12741551 / 12741551 responses (100.0%)
[info] CPU 4827.4% | Mem 369MiB

[run 2/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   5.80ms   5.81ms   6.36ms   6.90ms   8.00ms

  14009190 frames sent in 5.00s, 13992806 frames received
  Throughput: 2.80M req/s
  Bandwidth:  19.25MB/s
  WS upgrades: 16384
  WS frames:   13992806
  Latency samples: 13992806 / 13992806 responses (100.0%)
[info] CPU 6574.7% | Mem 431MiB

[run 3/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   5.82ms   5.79ms   6.40ms   6.86ms   7.48ms

  13976393 frames sent in 5.00s, 13960009 frames received
  Throughput: 2.79M req/s
  Bandwidth:  19.21MB/s
  WS upgrades: 16384
  WS frames:   13960009
  Latency samples: 13960009 / 13960009 responses (100.0%)
[info] CPU 6281.9% | Mem 432MiB

=== Best: 2798561 req/s (CPU: 6574.7%, Mem: 431MiB) ===
[info] saved results/echo-ws/16384/lute.json
httparena-bench-lute
httparena-bench-lute
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-tls-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-32.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
[info] restoring loopback MTU to 65536
[info] restoring CPU governor → powersave

Upgrade Lute

43f5e75

enable native codegen

89fd334

try lower threadcount

d2c9a85

faster json, back to threads

a9927b8

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Upgrade Lute#632

Upgrade Lute#632
Nicell wants to merge 4 commits intoMDA2AV:mainfrom
Nicell:upgrad-lute

Nicell commented Apr 24, 2026

Uh oh!

Nicell commented Apr 24, 2026

Uh oh!

github-actions Bot commented Apr 24, 2026

Uh oh!

github-actions Bot commented Apr 24, 2026

Uh oh!

github-actions Bot commented Apr 24, 2026

Uh oh!

Nicell commented Apr 24, 2026

Uh oh!

github-actions Bot commented Apr 24, 2026

Uh oh!

github-actions Bot commented Apr 24, 2026

Uh oh!

github-actions Bot commented Apr 24, 2026

Uh oh!

Nicell commented Apr 25, 2026

Uh oh!

github-actions Bot commented Apr 25, 2026

Uh oh!

github-actions Bot commented Apr 25, 2026

Uh oh!

github-actions Bot commented Apr 25, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

Nicell commented Apr 24, 2026

Description

Uh oh!

Nicell commented Apr 24, 2026

Uh oh!

github-actions Bot commented Apr 24, 2026

Uh oh!

github-actions Bot commented Apr 24, 2026

Uh oh!

github-actions Bot commented Apr 24, 2026

Benchmark Results

Uh oh!

Nicell commented Apr 24, 2026

Uh oh!

github-actions Bot commented Apr 24, 2026

Uh oh!

github-actions Bot commented Apr 24, 2026

Uh oh!

github-actions Bot commented Apr 24, 2026

Benchmark Results

Uh oh!

Nicell commented Apr 25, 2026

Uh oh!

github-actions Bot commented Apr 25, 2026

Uh oh!

github-actions Bot commented Apr 25, 2026

Uh oh!

github-actions Bot commented Apr 25, 2026

Benchmark Results

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant